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Abstract 



During the last decade, it has been well understood that communication over multiple antennas can increase 
linearly the multiplexing capacity gain and provide large spectral efficiency improvements. However, the majority 
of studies in this area were carried out ignoring cochannel interference. Only a small number of investigations have 
considered cochannel interference, but even therein simple channel models were employed, assuming identically 
distributed fading coefficients. In this paper, a generic model for a multi-antenna channel is presented incorporating 
four impairments, namely additive white Gaussian noise, flat fading, path loss and cochannel interference. Both 
^vj , point-to-point and multiple-access MIMO channels are considered, including the case of cooperating Base Station 

clusters. The asymptotic capacity limit of this channel is calculated based on an asymptotic free probability approach 
which exploits the additive and multiplicative free convolution in the R- and S-transform domain respectively, as 
well as properties of the r\ and Stieltjes transform. Numerical results are utilized to verify the accuracy of the derived 
closed-form expressions and evaluate the effect of the cochannel interference. 
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Index Terms 

Information theory, Information Rates, Multiuser channels, MIMO systems, Cochannel Interference, Land mobile 
K^ , radio cellular systems, Eigenvalues and eigenfunctions. 

I. Introduction 

In many cases, wireless communication systems have to operate in the interference-limited regime, where the 
cochannel interference is much more pronounced that the receiver noise. This applies to all modern cellular systems, 
as well as in multi-spot beam satellites, where frequency reuse is employed over spatially separated geographical 
areas. The capacity of those systems is interference-limited, since by increasing the transmit power both received 
signal and cochannel interference increase and eventually the Signal over Interference and Noise Ratio (SINR) 
saturates. Although a number of previous studies in the literature JT], 13, Q, H, J5) have looked into the effect 
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of cochannel interference, the majority of the employed channel models were focused on specific cases, failing to 
capture the wide range of affected systems. 

In this context, this paper generalizes and studies the effect of cochannel interference on multiantenna Gaussian 
fading channels. More specifically, the main contributions herein are: 

1) The introduction of a generic multidimensional channel model which encompasses four channel impairments, 
namely additive white Gaussian noise (AWGN), flat fading, path loss and cochannel interference. The proposed 
model can be employed as a generalization of point-to-point MIMO channels, as well as uplink and downlink 
channels of MIMO cellular systems, cooperating Base Station clusters and multi-spot beam satellite systems. 

2) The analytical calculation of the asymptotic eigenvalue probability distribution function (a.e.p.d.f.) based on 
a free probability approach which exploits the additive and multiplicative free convolution [6| in the R- and 
5-transform domain respectively, as well as properties of the r\ and Stieltjes transform. 

3) The derivation of closed-form methods which calculate the system capacity based on the number of dimensions 
and the transmit power of useful signals and cochannel interference. 

4) Numerical results which verify the validity of the free probability derivations and provide insights into the 
capacity performance of cochannel-interfered systems. 

The remainder of this paper is structured as follows: Section[n]introduces the generic channel model and provides 
a detailed review of cochannel interference scenarios. Section [Til] describes the free probability derivations and the 
capacity results, while cumbersome mathematical derivations are postponed to the appendix. Section [IV] verifies 
the accuracy of the analysis by comparing with Monte Carlo simulations and evaluates the effect of the cochannel 
interference in the context of cooperating BS clusters. Section [V] concludes the paper. 

A. Notation 

Throughout the formulations of this paper, E[-] denotes the expectation, (•) denotes the conjugate transpose 
matrix, (•) denotes the transpose matrix, denotes the Hadammard product and ® denotes the Kronecker product. 
The Frobenius norm of a matrix or vector is denoted by ||-||, the absolute value of a scalar is denoted by |-| and 
the delta function is denoted by S(-). (•)+ is equivalent to max(0, •) and 1 {•} is the indicator function. 

II. Generic Channel Model & Related Work 

A. Generic Channel Model 

The generic channel model which combines additive white Gaussian noise, flat fading, path loss and cochannel 
interference can be expressed as follows: 

y = Hx + HiXi + z, (1) 

where y denotes the K x 1 received symbol vector and the K x 1 vector z denotes AWGN with E[z] = and 
E[zz H ] = (J. The M x 1 vector x denotes the transmitted symbol vector with Signal to Noise Ratio (SNR) /i 

1 The variance of AWGN has been normalized to 1 to simplify notations 
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(E[xx H ] = fiT), while the N X 1 vector xi denotes cochannel interference with Interference to Noise Ratio (INR) 
v (EfxiXp] = vY). It should be noted that fi represents the transmitted desired signal over noise power ratio 
(TSNR), while v represents the transmitted interference over noise power ratio (TINR). The K x M channel matrix 
H = SqG comprises of the Hadammard product of a Gaussian matrix vec(G) ~ CJ\f(0, 1) including the flat fading 
coefficients of the communication system and a variance profile matrix S including the path loss coefficients of the 
communication system. Similarly, the K x N channel matrix Hi = Si Gi comprises of the Hadammard product 
of a Gaussian matrix uec(Gi) ~ C/V(0,I) including the flat fading coefficients of the cochannel interference and 
a variance profile matrix Si including the path loss coefficients of the cochannel interference. The exact structure 
of the variance profile matrices depends on the considered wireless scenario and it is discussed in detail in the 
It is also assumed that: 

• x and xi are Gaussian inputs 

• Cochannel interference is treated as noise 

• Channel State Information (CSI) is available at the receiver but not at the transmitters. Therefore, no input 
optimization takes place in order to avoid cochannel interference. 

In the proposed model, the combined effect of receiver noise plus cochannel interference can be represented by 
a combined vector zi = Hixi + z which is characterized as colored since its covariance E^iz^] = I + z/HiH^ 
is no longer proportional to the identity matrix. The capacity of the generic model normalized by the number of 
receive dimensions is given by an expression of the following formj [8], (H, Q: 



following section 



C = — E 
K 



logdct (i + f iHH H (I + i/HiHf) 



(2) 



Remark 2.1: At this point, it should be noted that the variance profile matrices should satisfy a number of 
conditions for the analytical results of section [HI] to be valid: 

« S and Si are assumed to have uniformly bounded entries with growing dimensions and satisfy Lindeberg's 

condition. 
> S and Si are assumed to be asymptotically row-regular. 
Definition 2.1: An N x K matrix X is asymptotically row-regular J6] if 

1 - 

K— ^oo J\ * — ' 
3=1 

is independent of i for all a € R, as the aspect ratio -^ converges to a constant. 

"In the previous notation, it is assumed that TSNR is identical for all desired dimensions and the TINR for all interfering dimensions. If this 
is not the case, variations in the transmit power across the multiple dimensions can be incorporated in the variance profile matrices S and Si 
respectively. 

3 It should be noted that eq. (2) can be also written as C = -^E[logdct(I + (iHH H + i/H T Hf )] - -^E[logdet(I + i/H T Hf )] as in Q. 
However, this paper focuses on eq. (2) in order to distinguish and exploit the structure of matrices X and Sj. 
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To simplify the notations during the mathematical analysis, the following auxiliary variables are defined: 

K = fiHU H (I + i/HiHf ) _1 
M= (1 + i^HiHf)" 1 
N = fiHH H 

N = i/HiHf 

M 

'=* 

TV 
7 



A" 

9 



sil 2 



a/a 

where j3, 7 are the ratios of horizontal to vertical dimensions of matrix H, Hi respectively and q,p are the squared 
Frobenius norms of matrices S, Sj respectively normalized by the matrix size. 

B. Wireless Scenarios with Cochannel Interference 

This generic model can encompass a wide range of point-to-point and multiple-access MIMO channels by altering 
the structure of the variance profile matrices and the meaning of the channel matrix dimensions, as described in 
the following paragraphs. 

1 ) Single MIMO Link with Equidistant Cochannel Interference: In this scenario, a single MIMO link is considered 
whereas the receiver is impaired by a) a single cochannel MIMO interferer or b) a number of equidistant interferers. 
An example for case (a) would be two point-to-point MIMO links operating in close proximity, while for case (b) a 
cell-edge multiple-antenna terminal at the downlink channel receiving interference from adjacent equidistant Base 
Stations (BSs). In the described scenarios, the path loss coefficients can be considered identical and therefore 
the variance profile matrices are matrices of ones: S = Si = I. In addition, K and M equal the number of 
receive antennas and the number or transmit antennas at the desired terminal respectively. N equals the number 
of transmit antennas at the interfering terminal in case (a) or the number of interfering BSs in case (b). Authors 
in investigated the correlated MIMO capacity with correlated cochannel interference, as well as the optimum 
signaling for fading channels. Using complex integrals and Grassman variables, the mutual information moments 
have been derived and a method for optimizing the input signal covariance based on the correlation matrices was 
presented. It has been shown that in many cases, the input optimization yields capacities close to the closed-loop 
capacity, where instantaneous channel state information is available at the receiver. 

2) Single MIMO Link with Distributed Cochannel Interference: In this scenario, a MIMO link operating within 
a traditional cellular system is assumed. In the uplink, each BS receives cochannel interfering signals from the User 
Terminals (UTs) of adjacent cells. Similarly, in the downlink each UT receives cochannel interference from adjacent 
BSs. The main differentiation between uplink and downlink is that in the former case interference originates from 
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a large number of low-power randomly-distributed sources (UTs), whereas in the latter case interference originated 
from a small number of high-power regularly-distributed sources (BSs). In both uplink and downlink, the variance 
profile matrix S is a matrix of ones S = I, while the structure of matrix Si = erf (g) I is dictated by the spatial 
distribution of the interferers, where er\ is a vector including the path loss components of the interferers. Regarding 
the uplink channel matrix dimensions, K and M refer to the number of receive antennas at the BS and the number 
of transmit antennas at the UT respectively, while N refers to the number of interfering UTs multiplied by the 
number of transmit antennas per UT. Authors in [2] have investigated this scenario and have derived an asymptotic 
closed-form expression as a function of K,M,N,p,q for AWGN and fading channels. According to this study 
the spatial noise coloring due to cochannel interference can be exploited by the multiple-antenna receiver in order 
to achieve higher channel capacities. Subsequently, the author in U has studied the optimum signaling in MIMO 
channels with cochannel interference. In this context, it has been found that the optimal signaling converges to the 
interference-free signaling only when interference is sufficiently weak of sufficiently strong. 

3) MIMO Cellular System with Wideband Transmission Scheme: This scenario considers a single cell which 
operates on wideband transmission scheme (i.e. superposition coding) and receives interference from adjacent 
cells. The wideband transmission scheme implies that all UTs of the cell of interest transmit over the same channel 
dimensions using superposition coding |9), ifTOl . Assuming BS and UTs equipped with multiple antennas, the uplink 
can be represented by a MIMO multiple-access channel. In this case, the structure of matrix S = er T ®I is dictated 
by the spatial distribution of the intra-cell UTs, while Si = erf I is dictated by the inter-cell interferers, where 
er is a vector including the path loss components of the desired UTs. Regarding the channel matrix dimensions, K 
refers to the number of receive antennas at the BS, M refers and the number of UTs times the number of transmit 
antennas at the UT and N refers to the number of interfering UTs times the number of transmit antennas per UT. 
This scenario has been studied in [11], where various multiuser MIMO processing techniques are considered in the 
presence of cochannel interference. Furthermore, it is shown therein that linear MMSE (Minimum Mean Square 
Error) filtering yields eq. (fJJ, assuming full CSI at the receiver. 

4) Cooperating BS Cluster: In this scenario, a cluster of cooperating BSs (or distributed antennas) is considered, 
receiving interference from similar adjacent clusters. Many variations of this scenario can be described by the 
generic channel model. For example, the BSs and UTs may be equipped with single or multiple antennas. In 
addition, orthogonal (single transmitting UT per cluster) or wideband (multiple transmitting UTs per cluster) 
transmission scheme can be considered. In all aforementioned cases the variance profile matrices have a special 
structure defined by the spatial distribution of BS clusters and intra-cell/inter-cell UTs. The defining characteristic 
of all the aforementioned cases is that matrices S and Si can no longer be expressed in terms of the vector er or 
o\. The reader is referred to [12| for a detailed review of variance profile matrices for BS cooperation systems. 
Cooperating BS clusters were also considered in [4|, using inter-cell scheduling to avoid cochannel interference. 
Furthermore, the authors in Q consider BS clusters with frequency reuse 1 on a circular Wyner array, although all 
intra-cell UTs are assumed to have equal path loss coefficients in order to provide mathematical tractability. 

Remark 2.2: It should be noted that the generic model and capacity derivation in this paper generalize all the 
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aforementioned scenarios by making no simplifying assumptions except the asymptotic row -regularity of the variance 
profile matrices. In terms of wireless scenarios, asymptotic row-regularity means that each receiving element collects 
in total the same power from all transmitters. This is always true for multiple collocated omnidirectional receive 
antennas, such as scenarios III-B1I III-B2I However, for spatially distributed receive antennas such as in scenarios 
III-B31 III-B4I asymptotic row-regularity translates into symmetric cells in terms of spatial user distributions. This 
assumption becomes more valid for asymptotically large number of cells and users. 

III. Eigenvalue Distribution Analysis 

As it can be seen, the generic channel model of eq. (QJ and its ergodic capacity in eq. (0) describe a wide range 
of multiantenna and multiple-access channels impaired by additive white Gaussian noise, flat fading, path loss and 
cochannel interference. In order to tackle this problem analytically, we resort to asymptotic analysis which entails 
that the dimensions of the channel matrices grow to infinity assuming proper normalizations. It has already been 
shown in many occasions that asymptotic analysis yields results which are also valid for finite dimensions J6], Q, 
iTHl . In other words, the capacity expression converges quickly to a deterministic value as the number of channel 
matrix dimensions increases. Eq. (O can be written asymptotically as: 



C = 

K,M,N^oo K 



lim E 

K,M,N-yoo 



lim — E [log det (l + /iHH ff (I + z/HiH T ff ) 

l,N->oo K L V v ' 

if>g(l + Xi(K)) 

/■OO 

= / log(l + x)fg(x)dx, (4) 

Jo 

where A,; (K) is the ith eigenvalue of matrix K and /£? is the a.e.p.d.f. of K. It should be noted that while the 
channel dimensions K, M, N grow to infinity the ratios of horizontal to vertical dimensions /3, 7 are kept constant. 
More importantly, TSNR and TINR /i, v grow small as the transmit dimensions M, N grow large in order to 
guarantee that the system TSNR and TINR fi = Al/i, v = Nv remain constant and do not grow infinite in the 
context of asymptotic analysis. Based on the aforementioned conventions, the following auxiliary variables are 
defined: 

- W is 
Q = -J = Kfiq 

p = — = Kvp 

7 

To calculate the expression of eq. ©, it suffices to derive the a.e.p.d.f. of K, which can be achieved through the 
principles of free probability theory 1T41 . fl31 . Ifl6l . ifTTl as described in the following paragraphs. 

Remark 3.1: It should be noted that other techniques have been also used in recent literature for large random 
matrix analysis. Most notably, the replica analysis method |[T8l and the deterministic equivalents method [19| have 
been applied in a range of wireless scenarios for deriving ergodic, outage capacities and precoding methods. 
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A. Random Matrix Theory Preliminaries 

Let /x(#) be the eigenvalue probability distribution function of a matrix X. 
Definition 3.1: The ^-transform of a positive semidefinite matrix X is defined as 



f°° 1 

mc(7)= / T~i fx{x)dx. (5) 

Jo l+jx 

Definition 3.2: The ^-transform of a positive semidefinite matrix X is defined as 

SxW=-^ x 1 ( I + l). (6) 

Property 3.1: The Stieltjes-transform of a positive semidefinite matrix X can be derived by its 77-transform using 
|6] Equation 2.48] 

s^ x) = -^tlM. (7) 

x 

B. Free Probability Results 

The asymptotic capacity limit of this channel is calculated based on an asymptotic free probability approach 
which exploits the additive and multiplicative free convolution in the R- and S-transform domain respectively, as 
well as properties of the r\ and Stieltjes transform. The derivation methodology in this paper can be summarized 
as follows: 

1) Derivation of a.e.p.d.f. of N,N through additive free convolution (Theorem 13. It 

2) Derivation of inverse 77-transform of M through Cauchy integration (Theorem I3.21 i 

3) Derivation of Stieltjes transform of K through multiplicative free convolution in the S'-transform domain 
(Theorem [33} 

4) Calculation of /■£? through Lemma 13.21 

5) Integration based on eq. (01 in order to calculate capacity 

Theorem 3.1: The a.e.p.d.f. of N, N follows a scaled version of the Marcenko-Pastur law, as long as X, Si are 
asymptotically row-regular. 

Proof: Considering a Gaussian channel matrix G ~ CAT (0, 1), the empirical eigenvalue distribution of ^GG H 
converges almost surely (a.s.) to the non-random limiting eigenvalue distribution of the Marcenko-Pastur law |20l . 
whose density function is given by 

fI GG H(x)^ ./mp(x,/3) (8) 



, J(x-a) + (b~xY 

f MP ( x ,{3) = (l-[3) + 6(x) + ^ 



2irx 
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where a = (1 — \/ r /3) 2 , b = (1 + \/]3) 2 and ?7-transform, S'-transform are given by (6| 

Vur(xJ) = l-^ (9) 



<Hx,/3)= Ux(\ + y/p) 2 + l-ya;(l-v^) 



2 



S M p(a:,^) = ^— - (10) 

and j3 is the ratio of the horizontal to the vertical dimension of the G matrix. 

According to l2TI . 11221 . Il23l . the channel co variance matrix HH H can be decomposed into a sum of unit rank 
matrices which are assumed asymptotic freqj. Using additive free convolution in the i?-transform domain, the 
empirical eigenvalue distribution of ^HH ff is shown to converge almost surely (a.s.) to a scaled version of the 
Marcenko-Pastur law 11201 , as long as £ is asymptotically row-regular 

/JhhhW^ fup(qx,P) (11) 

or equivalently 

fg(x)^> fap(9x,0) (12) 

/^W^ fupipxn)- (13) 

■ 

Lemma 3.1: The S'-transform of N, N converges almost surely (a.s.) to: 

Sn(x)^> i-ji- (14) 

gp+a; 

SnW^> i-J- (15) 



Proof: According to Theorem 13.11 and Definition [3T 



»?n(*) -^ r)Mp{qx,l3) (16) 



Using Definition 13.21 and eq. (O, 



t?n (#») ^ -f/Mpt 1 ^) (I 7 ) 



S N (a;)--^^7/ N 1 (.T + l) 



-S M p(a;,/3) 



1 1 



(18) 



q P + x 
A similar derivation can be followed for Sj^(z/). 

4 The reader is referred to 1211 . 1221 for a complete proof of Theorem 13. II 
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Theorem 3.2: The inverse ^-transform of M is given by: 

(.t- 1) ( yl + (x - "if p 2 + (2 7 + 2 a;) p + 1 + (7 - x) p J 
7m (*) = ^ -■ (19) 

Proof: See Appendix lAl ■ 

Theorem 3.3: The inverse ^-transform of K is given by: 

^(*) = \j^Zl^\x) (20) 

Proof: Assuming asymptotic freeness|f| between matrices N and M, the ^-transform of K is given by multi- 
plicative free convolution: 

S K (a;) = S n (s;)Em(j:) <=> 

/ X + 1 \ 1 , v 1 1 / x + l\ , , 

to* * + 1 = ^77^ %V + 1 

V a? / q p + x \ x J 

where step (a) combines Definition 13.21 and eq. (TBI . The variable substitution y = x + 1 yields eq. (|20] |. ■ 

Lemma 3.2: The a.e.p.d.f. of K is obtained by determining the imaginary part of the Stieltjes transform S for 

real arguments 

fg(x)= lim -3{S K (x+jy)}, (21) 

j/-^0+ IT 



where the Stieltjes-transform S of K is given by Property 13.1 1 and the 77-transform of K is calculated by inverting 
eq. (|20). 

Lemma 3.3: The a.e.p.d.f. of M is obtained by determining the imaginary part of the Stieltjes transform S for 
real arguments, where the Stieltjes-transform S of M is given by Property 13.11 and the ^-transform of M is given 
by eq. ( f2Tb in Appendix lAl 

IV. Numerical Results 

In order to verify the accuracy of the derived closed-form expressions and gain some insights on the capacity 
performance of the proposed generic model, a number of numerical results are presented in this section. In the 
following figures, solid lines are plotted based on closed-form expressions, while bars and circle points are calculated 
based on Monte Carlo simulations. 

independent unitarily invariant matrices with compactly supported asymptotic spectra [6 Example 2.45], such as Wishart and inverse Wishart 
matrices with identity covariance matrix |24| , are asymptotically free. The matrices N and M are independent, but the unitary invariance is 
not straightforward. More specifically, N is a Wishart matrix with a covariance matrix which depends on S and thus its distribution belongs to 
a more general class, called elliptically contoured matrix distribution 1241 . In addition, M is the inverse of a non-central Wishart matrix as the 
sum of the channel covariance and the identity matrix. Nevertheless, the assumption of asymptotic freeness has been motivated by the accuracy 
of eigenvalue distributions and the fact that similar approximations have been already investigated in an information theoretic context, providing 
useful analytical insights and accurate numerical results 1251 , 1261 . 
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A. A.e.p.d.f. Results 

The accuracy of the derived closed-form expressions for matrices K,M,N is depicted in Figure Q] The solid 
line in subfigure |l(a)| is drawn using Theorem B.ll and specifically eq. ([T2] |. in subfigure 1 1 (b)| using Lemma [331 and 
in subfigure |l(c)| Lemma 13.21 The histograms denote the p.d.f. of matrices K,M,N calculated numerically based 
on Monte Carlo simulations. More specifically, the matrices G and Gi are generated using independent identically 
distributed (i.i.d.) complex circularly symmetric (c.c.s.) elements for 10 3 fading instances and the matrices S and 
Si using the following simplified model for diminishing off-diagonals: 

0j i = — =, (22) 

l ' 3 v/i + N-jf 

where <7,j is the (i, j)th matrix element of S or Si. It can be seen that there is a perfect agreement between the 
two sets of results. 

Figure [2] depicts the effect of transmit power {p,, v) and channel dimensions (/?, 7) on the a.e.p.d.f. of matrix 
K. As it can be observed, the a.e.p.d.f. has four degrees of freedom, each one contributing to the shape of the 
curve. The final shape would be determined by combining those four contributions, namely the transmit power of 
desired dimensions /i, the transmit power of interfering dimensions v, desired transmit over receive dimensions (3 
and interfering transmit over receive dimensions 7. The effect of the quantities q,p is similar to that of /x, v and it 
is not depicted for the sake of conciseness. 

B. Capacity Results 

In this paragraph, the focus is on cooperating BS clusters in the context of a linear cellular array with single- 
antenna BSs / UTs and wideband transmission scheme, as depicted in Figure [3] However, the presented closed-form 
expressions can be straightforwardly applied to planar arrays and multiple-antenna BSs and UTs. The parameters 
used for producing the capacity results are presented in Table [Q The transmit power Pt, the number of UTs per 
cell /3 and the cell size R are kept constant while the number of cells K participating in the cluster varies. The 
simulated system considers 50 cells in total and 10 3 Monte Carlo (MC) iterations. The UTs are assumed to be 
distributed on a regular grid across the system coverage span. TSNR and TINR are calculated as follows: 

^ = V= ^ (23) 

while a power-law path loss model 11271 . 11281 . ifTZl is employed for constructing the variance profile matrices S, Si: 

Ui,3 



*J=V*> [!+■%) , (24) 

where aj is the (i, j)th matrix element and di t j is the spatial distance between the ith receive dimension and the 
jth transmit dimension. The quantities q,p can be calculated either numerically or based on closed-form expressions 
as described in (29), |[30l for linear and planar cellular arrays respectively. It should also be noted that scaling the 
cluster size K affects the structure of matrices S, Si and as a result the quantities q,p. In this direction, the capacity 
plot versus cluster size in Figure |4] includes two sets of results. The circle points denote values calculated based on 
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simulating the channel matrices and averaging using eq. ©. The solid line is plotted using eq. (0]i and Theorem 
13.21 As it can be seen, the potential spectral efficiency of cooperating BS clusters is very high even for moderate 
cluster sizes. 

V. Conclusion 

In this paper, a generic multiantenna channel model was introduced, incorporating Gaussian noise, flat fading, 
path loss and cochannel interference. The proposed model generalizes and extends previous models in the literature 
by considering profile matrices which shape the variance of the fading coefficients for both desired and interfering 
signal dimensions. As a result, it is possible to describe a wide range of cochannel interference scenarios, including 
single-user and multi-user MIMO, as well as cooperating BS clusters, also known as distributed antenna systems. 
Based on a free probability approach, the asymptotic eigenvalue distribution has been derived, resulting in closed- 
form expressions which depend on TSNR, TINR, channel dimensions and norms of the variance profile matrices. 
Furthermore, the derivations herein have demonstrated how complicated channel matrix expressions can be tackled 
by additive and multiplicative free convolution in the R- and 5-transform domain respectively, as well as properties 
of the r) and Stieltjes transform. Finally, the derived a.e.p.d.f. of the matrix products in the log det formula was 
utilized to calculate the capacity of cooperating BS clusters by varying the size of the cluster and to provide an 
estimation of the resulting spectral efficiencies. 

Appendix A 
Proof of Theorem 13. 21 

Since the a.e.p.d.f. /~?(x) is known, the a.e.p.d.f. of f^(y) can be calculated considering that y = (1 + x)^ 1 , 
where y and x represent the eigenvalues of M and N respectively: 

1 



/m(2/M) 



y'(y 1 (x)) 



fxiy- 1 ^)) 



l-x 



= *~V£ ( — - ) • (25) 
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Following the definition of ^-transform [6, Definition 2.111, ||3T| : 



+00 -. 



VmW = I 1+ , /m(^ 



2/n(— r^ ) dx 



1 + tpx X 
-°° w + 1 



+oc 1 + 1P + W J * ! 

w + 1 



f^(w)dw 



. x 1 + ip + w 

1 w + 1 1 



fe(w)dw 



a l + 1p +W 2-KWp 



-y(b — w)(x — w)dw 



m f™ 2 l+p(l + 7 + 2V7Cosw) . 2 

= —7 / —-, w ; ; rr sin Lodu! 

'Jo 7T (1 + 7 + 2^7Cosw)(l + -0 + p(l + 7 + 2^/jcosuj)) 

1 /" 27r (l+p(l + 7 + x /7(e' ;w + e-^)))((e^-e- 4 ")/2i) 2 

Wo (l + 7 + \/7(e i " + e- i "))(l+V'+p(l+7 + /f(e m + e-""))) 

(c . 1 / (i+p(i+ 7 + v7(c + r 1 )))(c-r 1 ) 2 



7 4 ? 7r ^ c , =1 C(l + 7 + V7(C + C- 1 ))^ + + P(l + 7 + V7(C + C- 1 ))) ^ 

J_/ ((i+p(i + 7 ))C + V7P(C 2 + i))(C 2 -i) 2 , r r _ 

7 ^J| C | =1 C 2 ((i + 7)C + V7(C 2 + i))(C(i + ^+p(i + 7)) + V7p(c 2 + i)) <■ l ; 

where a — p{\ — y^j) 2 and b = p(l + y^f) 2 - Step (a) requires the variable substitution x = l/(w + 1), dx = 

— 1/(1 + w) 2 dw, step (b) requires w = 1 + 7 + 2^/7 cosw, dw = 2^/ ? y(— sinoo)doj and step (c) £ = e 1 ", d£ = j£dw. 

Subsequently, a Cauchy integration is performed by calculating the poles Q and residues pi of eq. 

Co, 1 = 0, 

-(I+7) ±(1-7) 



(2, 



3 



2^7 



- (1 + f)p - 1 - 41 ± ^(7 - i) 2 p 2 + 2 (1 + v) (1 + i)p + (1 + V-0 2 

C45 = 



A) 



2PV7 
p + P7 + i\> 



PI 
1 
Pi 



P2,3 = - 
P4,5 = ± 



V7' 
7"1 



7 + ^7' 

(-((l+7)p+l+V')V(^- 1 ) 2 P 2 + 2 ( 1 +^)( 1 +^)P+( 1 +^) 2 + (^- 1 ) 2 P 2 + 2 ( 1 + , /')( 1 +7)P+(l+'/') 2 )'/' 
pj (l+^)(-V(7-l) 2 P 2 +2(l+V')(l+7)P+(l+i/>) 2 + (l+7)p+l+'>/') 

Using the residues which are located within the unit disk, the Cauchy integration yields: 

7 
rjMKW) = -^(Po+ P2+ P5) 



(l+V0(-^p 2 (-l+7) 2 +2(l+V)(7+l)p+(l+«A) 2 +V'+l + (7+l)p) 

(27) 
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Inversion yields eq. ( [T9i >. 
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TABLE I 
Parameters for capacity results 



Parameter 


Symbol 


Value/Range (units) 


Cell Radius 


R 


1 Km 


Reference Distance 


d 


1 m 


Reference Path Loss 


Po 


34.5 dB 


Path Loss Exponent 


n 


3.5 


UTs per Cell 





10 


Cluster Size 


K 


1-10 


Total number of cells 


K+f 


50 


UT Transmit Power 


Pt 


200 mW 


Thermal Noise Density 


N 


-169 dBm/Hz 


Channel Bandwidth 


B 


5 MHz 


Number of MC iterations 




10 3 
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16 



gz 




(a) A.e.p.d.f. for matrix N 




0.005 0.01 0.015 0.02 0.025 0.03 0.035 0.04 0.045 0.05 



(b) A.e.p.d.f. for matrix M 




(c) A.e.p.d.f. for matrix K 



Fig. 1. A.e.p.d.f. plots of matrices K, M, N. Parameters: ft = 5, 7 = 10, uq = 10, fip = 5. 
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(a) Parameters: fi = v = 7 = 1 



(b) Parameters: /i = v = j3 = 1 




(c) Parameters: u = /3 = 7 = 1 



(d) Parameters: /j, = ft = 7 = 1 



Fig. 2. The effect of transmit power (/^, f) and channel dimensions (/3,7) on the a.e.p.d.f. of matrix K. 
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Fig. 3. Graphical representation of a linear cellular array with cooperating BS clusters. 
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Fig. 4. Per-cell capacity scaling vs. the cluster size K. 
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